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ON GAUSS'S METHOD OF SUBSTITUTION. 

By Pepf. W. Woolsey Johnson, Annapolis, Md. 

In Gauss's notation the normal equations arising in the method of Least 
Squares, for fi unknown quantities x, y, z, . . . , t, are 

\ad]x -\- \ai'\y + \ac\z + . . . -f '\_al'\t = [ari] ] 
lai-\x + Vhbly + Vic\z + . . . + [W]< = [5n] I 

\al^x + \bl'\y + [c^> + . . . + [«]< = \ln'] ^ 

and the result of eliminating x by means of the first normal equation are 
written 

\hh, \-\y + [be, 11^ + . . . + \hl, l-]t = \bn, 1] 1 



[fo, \]y + \cc, 1]^ + • . • + id, l-\t = [en, 1] 



y (2) 



\hl, \]y + [c/, 1]5 + . . . + \ll, 1]< = [/», 1] J 

The fact that these " reduced normal equations," like the normal equations 
(1), have a symmetrical determinant suggests the question, May they not be 
regarded as normal equations derivable from certain fictitious observation 
equations for the // — 1 unknown quantities y, s, . . . , fi 

Oppolzer in fact raises the question directly (" Lehrbuch zur Bahnbestim- 
mung der Kometen und Planeten," vol. ii, p. 331) " whether the newly intro- 
duced symbols \bh, 1], \J)C, 1], • . . may be regarded, in analogy with the symbols 
\aa\, [a5], . . . , as sums of products of quantities related to each other in the 
same way ; " and he answers this question by finding i^m (m — 1) quantities 
(where m is the number of observation equations) corresponding to each letter 
b,c, . . . , l,ot which \bb, 1], [be, 1], . • . are the sums of products, (and of squares 
when the letters of the symbol are alike). From this he proceeds to draw 
" the important inference that [bb, 1], [cc, 1], etc. are positive. 

The fictitious observation equations which most naturally suggest them- 
selves would seem to be the m equations which result from the elimination of 
X from the observation equations by means of the normal equation for x. 
That these equations, in fact, fulfil the requirements is readily seen ; for. 
Annals op Mathematics, Vol. VII, No. 3. 
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writing them in the form 

i\y + c'lS + . . . + l\t = n\ 1 
i\y + cV -f . . . + l\t = n% I 

y^y + c'^s + . . . + I'JL = n\ . 
their coeflScients and absolute terms are of the form 



a . 



[aal [««] ' 

whence, for example, 

[aa] laa] [aaY 

= [bc]-W^) = lic,l]. (4) 

So far as I know, this method of viewing the reduced normal equations 
did not appear explicitly in any treatise upon Least Squares prior to the third 
edition of W. Jordan's Vermessungskunde,* for reference to which I am 
indebted to Mr. Harold Jacoby. In the first volume of this work, which bears 
the separate title " Ausgleichungs-Rechnung," Jordan, at page 64, calls the 
equations of the form 

V ^= ax -\- by -\- cs + . . . -\- It — n (5) 

" Fehlergleichungen," and the results of eliminating x by means of the normal 
equation for x, in the form 

v = b'p + c's -\- .. . + I't — n', (6) 

" Eeduzierte Fehlergleichungen." He proceeds to show, as above, that the 
reduced normal equations are the normal equations which would arise from 
these reduced error equations, or the corresponding observation equations (3).t 
Since we can proceed in the same manner to the second reduced error equations 
and normal equations, and so on, it is obvious that we thus prove directly that 

*The first edition appeared under the title " Taschenbuch der praktischen Geometrie," Stutt- 
gart, 1874. The second edition was called "Handbuch der Vermessungskunde," Stuttgart, 1877. 
The third edition, improved and enlarged, appeared in 1888. 

tThe idea appears in a less explicit form iu Herr und Tinter's " Lehrbuch der Spharischen 
Astronomie," 1887, p. 47. 
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[vv] = [tin, /jt], without the intervention of the equation 

[vv] = [nn] — [anja; — (hn]y — ... — [lti]t . 

It would seem, however, that this aspect of the reduced normal equations 
must have been present to the mind of Gauss while writing Art. 182 of the 
" Theoria Motus," in which he discusses the function W which is [vv] consid- 
ered as a quadratic function of x, y, z, . . . , t, or Uv' when the v'a are in the form 

(5).* If ^i^ = is the normal equation for x, it is shown that TTi = TF — -p — , 

is a function independent of x ; and, since when JT = it has the same value 

as W, it is the result of eliminating x from W by means of the first normal 

equation. It is then shown that, Yi = 0, Z, = 0, etc. being the reduced normal 

equations, Yi, Z^, etc. have the same relation to W^ that X, Y, etc. have to W. 

Y^ 
In like manner T^ = TFj — ' is independent of y. and so on. Supposing 

there are four unknown quantities, the function W is thus finally reduced to the 
form 

^^ S ^ pBj + [S] ^ [& + '°'''*'''*-^ 

In the " Disquisitio de Elementis eUipticis Palladis " a somewhat different 
investigation of this function is given in which the characteristic Gaussian 
notation is used for the first time, and the constant iB shown to be {nn, fx]: 
Gauss here for brevity suppresses the demonstration that [bb, 1], [cc, 2], etc. as 
well as [aa] are positive, which is necessary to the proof that [nn, ft] is the 
minimum value of [vv]. But in the "Theoria Motus " he proves, for another 
purpose, that [pb, 1] is a sum of squares, " for," he says, " it is evident that 
Wi is derived from [vv] the quantity x being eliminated from v^, v^, . . ■ by 
means of the equation X= ; hence [bh, 1] will be the sum of the coefficients 

* Slight changes have been made in the notation. 

t This result is then used in finding the probability of a value of t. In the original edition of 
the " Theoria Motus" it is said that the probability that s (the fourth variable) shall differ from 

its most probable value by the quantity a is proportioned to e~ *'" {$'" here standing for [dd, 3]). 
This was a mistake for e , and the same mistake is repeated two lines below where l—^y, 

instead of 4/^'" is stated to be the measure of the relative precision to be attributed to the deter- 
mination. These mistakes are corrected in Bertrand's tranlation, entitled " Methode des Moindres 
Carres," p. 129, except that by a misprint the d has dropped out of the exponential leaving the 

meaningless expression e . By a remarkable coincidence we find also in Davis's translation 

of the •' Theoria Motus" e~ "". Indeed there seems to have been a strange fatality connected 

with this passage; for in the " Gesammelte Werke " the exponential is printed «~ .intro- 
ducing two new misprints. 
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of y'' in v^, v^, . . . after the elimination, each of which is a square." Again 
Encke, in his elaboration of Gauss's method {JBerliner Jahrbuch for 1835, p. 
277) remarks, for the same purpose, that " if in each v the value is given to x 

for which ^=0, the sum of the squares of these «'s is W — -^ — =r , and there- 

fore the coeiBcient of y^, which is \bb, 1], will be simply a sum of squares." 

In other words, TT, is the value of Sx^ when each v is expressed in the 
form (6), so that the coefficient of y^ in it is Hb"^ or \b'b''\, which is therefore 
equivalent to \hb, 1]. 

Among the advantages of this point of view in treating the reduced nor- 
mal equations, we may mention not only the ready proof that \bb, 1], \cc, 2], etc. 
are positive, and that [nn, //] is the value of \yv\ when «„ v^^ . ■ ■ are the 
residuals, but the simplification it introduces into Gauss's elegant discussion of 
the general value of the sum of the squares of the errors, and also its bearing 
upon the weights of the unknown quantities. 

It is noteworthy that if, after solving the // normal equations obtained 
from m observation equations, we should discover that the /^ unknown quanti- 
ties were connected by a rigorous equation of condition which had previously 
been overlooked, the most probable values of the unknown quantities would be 
changed even if the values we had already found for the unknown quantities 
happened to exactly satisfy the rigorous equation of condition. At first sight 
the rigorous relation being exactly satisfied would seem to be a confirmation of 
the values already obtained ; but this is evidently not true, the normal equa- 
tions used in obtaining them have now no standing, the true process being to 
eliminate one of the unknown quantities from the observation equations by 
means of the rigorous condition, and then form // — 1 normal equations for the 
remaining unknown quantities. We thus have a system of // equations for the 
jj. quantities only one of which is by hypothesis satisfied by the values already 
obtained. 

But suppose the rigorous equations of condition happened to coincide with 
one of the normal equations first found, say that for x. Then, in accordance 
with what has been shown above, the new normal equation, being formed from 
observation equations identical with the fictitious observation equations de- 
scribed above {x being the unknown quantity first eliminated) are the san^e as 
the reduced normal equations. They therefore lead to the same values of 
y, z, . . . , t a,s before, and hence also to the same value of x. 

Moreover we are led also to the same values of the weights ot y, z, . . . , t* 

* The Tftlue of \yo~\ remains also unchanged, but the mean error of an observation is decreased, 
since there are now but !'■ — 1 unknown quantities and we have to divide [Bii] by ot — ,"■ -|- 1 instead 
ot m — //■. 
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The weight of x is however increased. For supposing, as in the usual 
process for obtaining the weights, the values otx, y, . . . ,t when fully expanded 
in terms of the n's to be 

X =r ajMi + «5i«2 + . . . + a^n,^ , 

y = ^yfh + ^^n^ + • • • -f ^mfim , 



the inverse weight of x is 2V. The normal equation for x may be written 

^ ^ [an] _ [aS] [ac] ^ _ . 

\ad\ \aa\ ^ [ad] ' ' ' ' 

whence equating the coefficients of /ij, 

„ _ Jh [^ a _ M ^ _ 

' [aa] [aa]'^' [aa] '^' •"■■ 

Now if the value of * above is derived from a rigorous equation, the first 
term is independent of the observed values, and they only enter the value of x 
through the values of y, 3, . . . ; whence the coefficient of n, becomes 

__[«5] . _[ac] 
and the inverse weight becomes I'a'^. We have, then, 



whence 

'S'„2 v.. „' 

+ la" 



«1 


= 


«1 


+ «'i; 


V^2 


=:: 


I'a' 


2 f ««' 
[aa] 




[aaf 




= 


1 


4- 2'a'^ 




[aa] 





since 2!a(/ consists of terms involving 2'a/9, I'ay, etc. each of which is known 
to vanish. Thus the inverse weight is less and the weight greater than before. 



